Cooperative Batch Scheduling for HPC Systems

The batch scheduler is an important system software serving as the interface between users and HPC systems. Users submit their jobs via batch scheduling portal and the batch scheduler makes scheduling decision for each job based on its request for computing sources, i.e. core-hours. However, jobs submitted to HPC systems are usually parallel applications and their lifecycle consists of multiple running phases, such as computation, communication and I/O. Thus, the running of a job could involve different kinds of system resources, such as power, network bandwidth, I/O bandwidth, storage, etc. Today’s batch schedulers rarely take these resource requirements into consideration for making scheduling decisions, which has been identified as one of the major culprits for system wide